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Chapter 1 



Simulation 



1 . 1 Introduction 



In simulation, we start out by thinking we have the true model of nature or the 
economy or the economic process and we know everything. We don't have any 
observation problems, we know the parameters, we know the models, we know how 
to simulate. 

We have as our theoretical model the idea that there are hidden variables which 
we can model as coming from such joint distribution like the multivariate normal. 
We use the latter because it has nice properties especially for modehng many random 
variables at once. 

We have a model though that individual data series that we see in the economy, 
like the S & P 500 or the price of Ford stock are not normally distributed nor 
are simple transforms of them Uke the difference in natural logarithms of them at 
adjacent time points. Nor is the arithmetic return from one month end to the next 
month end normally distributed. 

So we have a theoretical model that we can simulate with which starts out with 
the hidden multivariate normal distribution of many variables and simulates those 
first. Then for each such variable we transform it so as to produce the observable 
variables such as Ford stock price or the return of Ford stock price which we also 
classify as an observable because the transformation involves no estimated parame- 
ters. 

So step one is generate all the normal variables at once for a given time period 
using a multivariate normal distribution. This models their correlation. Now we 
take each individual normal and turn it into an observable. The way we do this 
is by matching the univariate normal distribution's cumulative distribution to the 
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univariate cumulative distribution of some other distribution like logistic. At this 
point, we know the parameters of the logistic or final distribution as we might call 
it or finaJ output distribution. 

We also know the mean and variance of the inner core normal. In this model, 
it doesn't actually matter what those are as long as the variance isn't zero. The 
reason is that the parameters of the "output" univariate distribution will undo any 
effect of the mean or non-zero variance of the normal. 

So we say that the cumulative normal (of the univariate normal distribution) 
up to the simulated value x equals the cumulative distribution of the "output" 
distribution, say the logistic, whose value we call y. The distribution of y values 
doesn't depend on the mean and variance of the normal as long as we use the same 
mean and variance for x's cumulative distribution to transform x to y as we used to 
simulate x. 

We thus solve for y by equating its logistic or whatever cumulative density to 
the cumulative density of x, with the same mean and variance for the cumulative of 
X as are used to generate x. And as long as that is done and x is univariate normal, 
it doesn't matter what mean and variance were used to generate x as long as the 
variance wasn't zero. 

So we solve for y and that is now our output variable. The variable y might 
however be something now like the change in the logarithm of the stock price or 
index over some period of time, like a month. 

Note that the transformation has to pick a specific time interval for it to be 
based on which has some specified logistic. It is possible to define a continuous in 
time output variable but it will only be logistic with specified parameters over some 
specific interval. 



We assume that x is multivariate normal, MVN, with probability density function 



1.2 MVN 



Let x be an n by 1 column vector. The 1 by n row vector x' is given by 



(1.1) 
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g-i(x-^)'£-»(x-M) 



(1.2) 



1.3. UNIVARIATE DISTRIBUTIONS 

1.3 Univariate Distributions 
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For each Xi we transform to a variable defined by the following procedure. Let 
fjbi and (7i be the parameters of the univariate distribution for Xi. Let Fi{xi\ix^a'^) 
be the normal cumulative distribution with mean jj. and variance for variable x^. 
We have 

F,{xu A^, a') = r dz^l=e-^(-^)'/-') (1.3) 

Let Gi{yi\7}) be the cumulative distribution function of a single variable with 
parameter column vector 77 of dimension ki hy 1. Let the corresponding probability 
density function be g{yi\rj)^ with appropriate modifications made for point masses, 
such as including a S function in g. Let yi be determined by the equation 

Fi(xi;/i,a2) = G,(yi;77) (L4) 

We solve the above equation for conditional on the parameter vector 77 after 
simulating the vector x including the value Xj. In this approach, Gi can be any 
univariate distribution 



1.4 Discrete time simulation 

We can simulate in discrete time, most simply when the time intervals are equal. 



1,5 Combining with other variables 

We can combine the variables generated in this manner with other variables, which 
themselves may follow a continuous time process. The vector x of MVN for tran- 
forming to logistics can be generated as part of that process, and we can for example 
choose to make that subvector have a mean of zero and standard deviations of one 
over the time intervals at which we wish results. ^ This sub-vector then furnishes 
a vector of MVN for the above transformation. For the case of fixed time intervals 
for the desired logistics, we simply specify the corresponding logistic distribution 
parameters for an interval of that size and use the generated MVN over that period. 



^This is not really necessary. 
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Chapter 2 

Esimation of Parameters 



For estimating parameters we have an inverse direction from simulation. In the case 
of simulation we start first with the simulation of the multivariate normal vector of 
variables first. Then we transform those to the individual output variables. This 
can be done by a transformation using cumulative density functions of the normal 
and any univariate distribution, such as a logistic. 

In the case of estimation, we start with data that is already transformed so to 
speak by "nature" or the economy. Our job as experimentahsts or as econometricians 
is then to reverse engineer nature. So we get from nature or the economy, variables 
that individually we identify as logistic or whatever. 

We believe there is an inner core of correlation that is hidden by the logistic or 
univariate distributions of individual data series, such as the S & P 500, Ford stock 
price, etc. 

We can't observe the correlation matrix directly nor estimate it directly from the 
observed univariate series, e.g. Ford stock price at month end, S &; P 500 at month 
end from January 1950 to January 2003, or whatever period we use or data series 
we observe. 

Because these invididual data series are logistic or whatever, we can't directly 
estimate the correlation matrix of them. The multivariate logistic is a very con- 
strained distribution that we don't want to be restricted by. We might also want to 
use other univariate distributions than logistic. 

So to uncover the hidden correlation of this collection of individual series, mod- 
eled by a collection of independent or seemingly independent univariate distribu- 
tions, we want to transform each individual data series so that the transformed ^ 
series is univariate normal. We then make the leap of faith, or assumption that 
these transformed series are in fact multivariate normal, MVN, and that we can 
estimate their correlation matrix by standard means for a MVN given a collection 
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of individual normals that are further assumed to be multivariate normal. As is well 
known, that is not guaranteed, but as modelers of nature or the economy we make 
that our assumption because its easier to build a model If that doesn't work we 
can try something else. 

So as econometricians our first problem is to estimate univariate distributions for 
each series that comes to us from nature or the economy, the SPX, Ford, whatever. 
We in fact first transform this by using differences in the natural logarithms of the 
series or constructing the arithmetic returns. Because these transforms involve no 
parameters to be estimated we think of this as still being the data that comes to us 
from nature or the economy. 



2.1 Estimation of Parameters 

Suppose we are given a vector of data y^, t=l,.,.,T, where yt is a vector of dimension n 
by 1. For each i, we take the time series yu, t=l,,..,T, where yu is the i-th component 
of yt. Given this data we can estimate a univariate distribution separately for each i. 
This can be done using standard univariate methods. Let the estimated parameters 
for each distribution be given by the vector rji, where rji is a A:^ by 1 column vector. 

Given these parameters, we can now transform to a distribution that is univariate 
normal. We discuss two ways to do this. One is to specify that the univariate normal 
has mean zero and variance 1. We then solve for xu for t=l,...,T such that 



This gives us a set of vectors Xt, t^l,...,T. We now estimate the correlation 
matrix among these using standard methods. Let this correlation matrix of the 
vector Xt at any time point be denoted W. 

We simulate with this approach a MVN with mean zero, and unit standard 
deviations with correlation matrix W. We then transform each yi individually using 



As an alternative, we could specify a vector /i for the MVN and a vector of 
standard deviations a. These could be the values estimated in the sample. 

As a short cut to estimate the correlation matrix, we can use the correlation 
matrix of the raw data. When dealing with some data, we may wish to take a 
transformation like the natural logarithm first. If we deal with stock data, for 
example we can. first take the change in the natural logs of the stock prices and 
treat those as the y's. In this form, we may use the correlation matrix of the y's as 
a quick estimate of the correlation matrix of the normal distribution. 




(2.1) 



Gi{.,bi). 



Chapter 3 



Statistics 



3.1 Univariate Logistic Distribution 

For any y between -oo and oo, let the cumulative distribution of y given parameters 
a and /? be 

^(f:«'^) = rTii^ (3.1) 

This can also be written 

G(y; a, (3) - ^(1 + tanh{^{x ^ a)/ (3)) (3.2) 

G is the cumulative logistic distribution and y is said to be logistically distributed 
or to have the logistic distribution. 



3.2 Logistic Normal Conversion 

To do conversion we equate the cumulative distribution function of the Normal to 
that of the Logistic, 

If we are simulating we simulate x with mean 0 and variance 1 and then use our 
model assumptions for a, and A for series i, e.g. Ford or S & P 500 or whatever. 

If we are estimating, we first estimate and Pi from a time series of and 
then we convert to x using the above formula given the observed value of ya. 
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In both cases yu is the return, log or arithmetic return, not the stock price or 
index value itself. For example x and y are both varying over -oo to oo. 

The above normal has zero mean and variance 1 which may seem counter- 
intuitive. Why doesn't it have a mean and variance corresponding to that of the 
logistic? 

The reason is it wouldn't matter. Suppose we use some /jl and a in the transfor- 
mation 



OO 



(3.4) 



It won't make any difference once we look at the combined effect of simulation 
as well as conversion. As long as we simulate with the same /x and a that we convert 
with, it doesn't matter what fi and a are as long as a is non-zero. We could use the 
values estimated from data, but we can also just use /x = 0 and cr = 1. 



3.2.1 Proof 

Suppose that we started with price data, then converted to differences of logs and 
estimated a logistic on that data. Suppose we also estimated the mean and standard 
deviation, and those had values /x and a. We have the j/it,t=2,..,T, and we solve for 
Xit, t=2,..,T. 



We then estimate our variance-covariance matrix W. However, for now lets 
pretend we have just one series i. Now we come to the simulation point. And 
imagine that we simulate uu using a normal distribution with /z = 0 and a = 1. 

Now we could calculate 

Xit = auit (3.6) 
We now calculate the cumulative distibution function, F using 

F = r dz , ^ e-2(^'^)'/-' (3 7) 



We can substitute for Xu as 



1 1/ ^2, 2 

dz . e"2(^-^) /'^ (3.8) 



7(2^ 



<t2 
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Now to calculate this integral, we tranform z to a standard normal. We do this by 
setting 

v = {z^ fi)/a (3.9) 
Making this transformation, we find that 

dz^-==e"2^" (3.10) 

Now this is the same thing as if we had just simulated uu and then used this 
cumulative distribution to calculate F. 

The value of yu depends on F, ai and Pi not on how F was calculated, as long as 
it produces the same F. So if we simulate u as mean 0 variance 1, and then transform 
u to some x which has mean fi and a and calculate F using the same /i and a its 
the same as if we calculate F using u and using — 0 and a = 1. 



3-2.2 Extension to other distributions 

The proof just given that the conversion from the normal to the non-normal dis- 
tribution was independent of the normal's mean and standard deviation as long as 
the same parameters of mean and standard deviation are used to generate the nor- 
mal deviates as to do the transformation did not rely on the characteristics of the 
logistic, and the same proof applies to any non-normal distribution. 



3.3 Gamma Distribution 

Reference Morris DeGroot ProbabiUty and Statistics p236. The probability density 
for the Gamma Distribution is 

5(a:|a,/?) = |^a:"-V^" (3.11) 

for a; > 0 and 0 otherwise. Here r{a) is the Gamma Function, which generaUzes the 
factorial, r(n) = {n- 1)!, 

This gives us a 2 parameter distribution. We can compute the cumulative dis- 
tribution function as 

G{y\a,p)= rdxf{x\a,p) (3.12) 

JQ 

So that 

G{y\a,l3)= Tdx^^x'^-'e-^' (3.13) 
Jq I [a) 
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We then convert from normals to this Gamma by first simlating a normal deviate 
u with cumlative density 

and then converting to y such that 

G{y\a,p) = F{u',fi,a^) (3.15) 

We have to interpret the results somewhat differently though. Since y is between 
0 and 00 it can be interpreted as the new price divided by the old price. In the case 
of the Logistic Distribution, we interpreted y as the change in the log of the stock 
price. Now we have to interpret it as the new stock price divided by the old stock 
price. 



3.4 Beta Distribution 

The beta distribution has probability density function 

for 1 > a; > 0 and 0 otherwise. 

To represent stock returns with this distribution it is necessary to convert the 
stock return or stock price to a variable between 0 and 1 and vice versa. We can 
do this by taking a lognormal variable and converting it into a unit deviate by 
calculating u from x by 

u = F{x-f/,a^) (3.17) 

or given x, solving for u. The superscript T reminds us these are the transformation 
parameters. One choice is fx^ = 0 and = 1. 

Here F is the cumulative distribution of some lognormal variable. This can differ 
from the normal used for the generation of the random normals. 

If we generated a normal x, converted that to u and then from that u to y for 
the Beta and then from that y back to x' as a normal, then we would have that x' 
was a normal determined essentially by the initial x directly. So we need a different 
method to generate a distribution of data. 



3.4. BETA DISTRIBUTION 
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3.4.1 Alternative generation of multivariate vector 

We can instead use the univariate distributions of logistic, beta, gamma, etc and 
generate uniform deviates Ui. We can then transform these to normals Xi. We can 
then take a linear combination of these Xu Vj = Et Rji^u where R is some matrix. 
Note the dimension of the x vector can be larger than the dimension of the sub- 
vector of y we wish to use. We can now treat the yj as changes in logs of stock 
returns. Or we could transform them to be between 0 and oo and interpret those 
as ratios of prices. 



In this approach we have a fundamentally discrete time generation process. 
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Chapter 4 
Regime Switching 



4.1 2 Regime Switching Model Lognornmal 

For this model, let the parameters be fii and cTj in state i, i=l,2. The parameters of 
the model shift at random times. Let pij be the transition rate per unit of time of 
going from state j to state i. 

The lognormal model is 

dx — Hidt + ffidz (4.1) 

when in state i. 



4.2 Estimating the parameters 

The parameters are estimated using maximum likelihood as in Hamilton, Time Series 
Analysis, Chapter 22. See for example Mary Hardy's North Ameican Actuarial 
Journal paper for an application to the two state regime switching lognormal. 



4.3 Estimating initial state 

The initial state can be represented as known in one of the regimes, or as a proba- 
bility density over them. 
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4.3.1 maximum likelihood 



Can use the maximum likelihood method in Hamilton. This produces the probability 
density. 



4.3.2 Trailing Data 

We can also use trailing data, especially daily data if available. We estimate the 
parameters in the previous N days, and then use a simple comparison to the two 
states of the model and use the one that is closest. Alternatively, a weight can be 
given to each of the possible states, e.g. if the trailing vol is 20 percent and there 
are two vol states of 15 and 25 percent, one could use a weighted average, computed 
in standard deviation or variance for example as the measure. 



4.4 Regime Switching Non-normal Models 

We can generalize the discussion of the last section to cover the other univariate 
models besides the lognormal. Let the model have a parameter vector 77, with 
elements 77^, i=l,..,nT,, where rijj are the number of elements in the vector 77. Let 
there be regimes of the parameters or discrete parameter sets. 

Using the same methods as for the lognormal model other models can be esti- 
mated. This is done using maximum likeUhood as in Hamilton. 



4.5 Advantages of Regime Switching 

4.5.1 Data description 

There Regime Switching Model (RSM) describes the effect in data of periods of 
different values of parameters. Periods of high volatility in particular are important 
in modeling indices, especial equity indices. The Regime Switching Model does 
more than model the fat tails of the data, it also models the tendency for one fat 
tail event to be followed by another, i.e. a switch in regime in which large losses 
or gains are more likely. This is important to option writers because such gains or 
losses have a non-linear effect on the option price. This non-linear effect and the 
probability of greater price changes then results in diffrent prices for the options, so 
that their expected return in the risk neutral probability is the same. In particular, 



4.6. CANADIAN AND US INSURANCE REGULATION 
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the optionality of the option, its convexity is worth more when volatility is higher. 
This leads to a higher price of the option, put or call. 



4.5.2 Risks to Option Writers Modeled by Regime Switch- 
ing 

Option writers, such as by variable annuity sellers, have the risk that volatility will 
change from what it is or they expect. When this happens, the Greek's of the 
options written change. This means that after a change in parameter values, the 
change in option prices for a given change in the stock price will be different. As a 
consequence, hedges set up to match Greeks, i.e. to match risk of the asset portfoho 
to the liability portfolio will no longer match. This is because the asset portfoho was 
chosen for a given set of Greeks. When the parameters change the asset and liability 
portfoho options all change in their Greeks, but because the Greeks are non-Unear 
functions of the parameters and the mix of options in the asset and liabihty portfoho 
are different the options will change their prices from the parameter change and their 
Greeks, so that there is a discrete change in price from the parameter change and 
a discrete change in Greeks. This can cause a loss itself and also means the asset 
portfolio no longer hedges the liability portfolio. 

The changes in prices and Greeks from the parameter change is a risk that can be 
analyzed using the regime switching model. Moreover, the change in hedge portfolio 
after the jump to one more appropriate to the new regime of parameters can be 
analyzed using simulations based on the regime switching model. One can estimate 
the cost for example of changing the hedges after a parameter change. Moreover, one 
can estimate the cost of the parameter changes and develop a portfolio to partially 
hedge this. 



4.6 Canadian and US Insurance Regulation 

Canadian and draft US C3 Phase II regulations for capital have a simulation op- 
tion or requirement (use of tables is allowed in Canada). This does not require use 
of regime switching, although the caUbration table in Canada was developed using 
regime switching analysis. Distributions with fat tails meet the calibration table 
with parameters that don't have super fat tails. By using a high enough volatil- 
ity the lognormal will meet the calibration table. The cahbration table requires 
the probability for large returns or laxge losses of specified size to exceed certain 
minimum probabilities. If one uses a lognormal and increases its volatility to fit the 
table, to meet all the points one needs a very large volatility, so that one exceeds the 
required probabihty for several of the points in the table. With the regime switching 
or other fat tailed distributions one can come closer to just matching each point in 
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Chapter 5 
ESG 



5.1 DMRP 

Let u and 6 follow the process 



du = Ki{e - u)dt + (Jidzide = ^2(02 - 6)dt + a2dz2 (5.1) 

under realistic probability. The correlation between dzi and dz2 is p. Let the risk 
neutral version be 

du = 4(0 - u)dt + oidzidcj) = 4(<^2 ^ </')^^ + ^2^-2^2 (5.2) 

Where the variable (f) is related to l9 by a Unear transformation. The correlation 
between dzi and dz2 is still p and the values of and ^2 are the same in real as 
risk neutral as is required from no-arbitrage. 

The instantaneous short term interest rate is 

^ = (5.3) 

The prices of bonds are solved from 
^(JiBuu + Buk\{<}> -u) + ^alB^ + Bu4,paia2 + ^^^(^^ - u) - e'^B + 5* = 0 (5.4) 

The parameters of the real and risk neutral processes are estimated from histori- 
cal data over different time periods starting in the 1950's to date for U.S. Parameters 
for other countries and for the Euro are also available as well as dual linked cur- 
rencies such as US Yen or Euro Yen in which the exchange rate is part of the state 
vector V and multiple sets of u, 6 ox u,^ are used for each economy. 
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In simulating real probability scenarios we can simulate u and 0 but with realistic 
probability parameters for this process, yet a 3rd process from the above. Given u 
and 4> we then calculate bond prices and yields. Alternatively, we can simulate u 
and 0 and then calculate <!> and then calculate bond prices. 



5.2 ESG^^ Simulation 

We first consider the case without regime switching. Let the vector v be m by 1, 
and let its elements be vq u, vi =^ cf), let Vi^i = xu for i = l,..,n where n is the 
dimension of the x vector, and we index x starting from 1. We now form the process 

dv = {b-\- Av)dt + Gdw (5.5) 

where b is m by 1, A is m by m and G is m by m. The vector dw is m by 1 and is 
a vector of mean 0, variance dt independent Wiener processes. We simulate v over 
some set of time intervals, which we suppose for simphcity are of equal size, At. We 
assume we start at t = 0, and generate a time series Vu t=0,..,T. So we simulate 
Vi, ...,vt and we start with vq. For stock return elements, i > 1 v^q = 0 and for the 
interets rate model we use i;oo = u and Vqi = 9, Here the first index of v is the time 
index t, and the second index the index j for the vector component. 

The first two elements of b and the first 2 by 2 sub-matrix of A are formed so 
as to repUcate the DMRP process above. All other elements of A and b are zero. 

The correlation matrix GG' is estimated for the joint correlation matrix of u, 6 
and x, i.e. v. 

We now simulate v and for each element of x, we have Xi — Vi-x suppressing the 
t index, and remembering we are indexing x starting with 1 and v starting with 0. 

We now convert each Xi to yi using the univariate distribution for yi. This can 
be normal or logistic or some other univariate distribution. We use the appropriate 
parameter vector hi to do this, taking care our parameters are approriate for the 
time interval A. As proven earlier it doesn't matter what the mean and variance of 
the Xi are at each t, as long as we use the same ones for the conversion as for the 
simulation. We can in fact just use unit normals used in generating the w[t] vector. • 



5.3 ESG with Regime Switching 

We have the vector of continuous variables 

rft; = (6 + Av)dt + GdM) 



(5.6) 
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In addition to this is the state index s, which we interpret as a set of a finite number 
of states. We have a mapping from s to b,A and G, assigning for each s, b(s), A(s) 
and G(s). Different values of s can then correspond to the different paramters of 
the univariate models for each index. We have a process on s, of the form p{s\ s)dt 
where p{s\s) is the transition rate per unit time to go from state s to state s'. In 
addition the transformation functions from v to y are indexed by .s in addition to 
their other parameters so y = h{v^ s, t) is the transformation function from v to y 
contingent on state s. 



5.4 ESG Estimation 

To estimate the correlation matrix of the ESG, we proceed along the Unes of Chapter 
2, but now include past values of u and 6 estimated from the yield curve on past 
dates to get these values and then estimate the correlation matrix of 9 and x. 

As before, we estimate each x time-series, e.g. S & P 500 or Ford stock price first 
as a univariate distribution, e.g. Logistic and then use the estimated parameters to 
transform to the normals using the cumulative distribution method. 
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Appendix A 



Notation 

A.l Basic parameters and variables 
A.l.l n 

The number of individual data series, e.g. S & P 500, Ford, etc. These are numbered 
1 to n. 

A.1.2 T 

The number of time periods, numbered from 1 to T. 
A.1.3 X 

An n by 1 vector from a multivariate normal distribution. 
A.1.4 y 

An n by 1 vector of variables transformed from x. These are the observables. 
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APPENDIX A. NOTATION 



A.1.5 E 

Correlation matrix that is n by n. Used to do simulation, and is the theoretical 
unobserved true correlation matrix of the x vector. 



A.1.6 W 

This is the estimated correlation matrix. It is used to do the actual simulation as if it 
was the theoretical correlation matrix when the software system is used in practice. 

A. 2 Returns 
A. 2.1 Log return 

Given any time series, 1^, t=:l,...,T, such as a price, or other variable which is non- 
negative, we can define its log return as Ut 

Ut = Invt - Invt-i (A.l) 
for t=2,..,T. We thus "lose" a data point at t=l. 

So for example, yu might be the change in the natural logarithm of the change 
of Ford's stock price. We calculate it from the observed stock prices, Pt and Pt_i as 

yu = InPt - InPt-i (A.2) 
where i corresponds to Ford, say i=l was Ford. 

To go the other way, to get Pt given ya we calculate 

Pt = Pt-ie^'' (A.3) 

We have to know Pt_i. If we are simulating we have to know Pq say and then we 
can simulate for later t using 2/ii,...,j/tT. 



